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Abstract 

We show that deciding whether a given quantum channel can be gener- 
ated by a Markovian master equation is an NP-hard problem. As a conse- 
quence, this result suggests that extracting the underlying physics governing 
the evolution of a quantum system, as described by its dynamical equations, 
may be a hard task regardless of how much data is gathered via measure- 
ments of the system. On the other hand, if the system dimension is fixed, the 
problem of deciding whether a process is consistent with being Markovian 
can be efficiently decided, and we give an explicit algorithm in this case. 
This work also leads to a complexity-theoretic solution to a long-standing 
open problem in probability theory. 
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1 Introduction 

Master equations and completely positive trace-preserving (CPT) maps provide 
two complementary descriptions of the dynamics of open quantum systems. CPT 
maps describe the dynamics in terms of discrete transformations between input 
and output states, whereas master equations describe the continuous -time evolu- 
tion of the system as governed by its Liouvillian. 

CPT maps appear frequently in quantum information theory, in which context 
they are often referred to as quantum channels as they provide a description of 
quantum dynamics that abstracts away the physical carriers of information. They 
also arise naturally in experimental measurement of quantum dynamics, when 
a complete "snapshot" of the dynamics is reconstructed using quantum process 
tomography JIl]. 

By contrast, master equations are the dynamical equations of open quantum 
systems. They directly describe the underlying physical processes governing 
the evolution. As such, they are frequently used to model realistic experimen- 
tal set-ups, especially in quantum optics lH] and condensed-matter physics [H], 
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where external noise and dissipation must invariably be accounted for. If the 
underlying physical processes are forgetful — as they commonly are to a good 
approximation — they can be described by a Markovian quantum master equation. 
Mathematically, such a Markovian master equation generates a one-parameter 
(time t) semi- group (evolving for time t and then time s is equivalent to evolving 
for time t + s) of CPT maps (the evolution must be completely positive and trace 
preserving at all times if expectation values of measurement are to be positive and 
sum to one). 

1.1 The Quantum Problem 

Two questions naturally arise concerning the relationship between these two de- 
scriptions of quantum dynamics. Given a dynamical equation described by a 
Markovian master equation, does it generate a completely positive evolution (and 
if so which CPT maps does it generate)? Conversely, given one or more CPT maps, 
are they generated by an underlying Markovian master equation (and if so which 
one)? These questions can equivalently be stated mathematically. Given a linear 
operator, does it generate a completely positive semi-group? Conversely, given 
one or more CPT maps, are they members of a completely positive semi-group? 

In seminal papers from the 1970's, Lindblad [0], Gorini and Kossakovski [Ht] 
gave a complete answer to the first question. They derived the general form — 
now known as the Lindblad form — for the generators of one-parameter completely 
positive semi-groups. The Liouvillian of any finite-dimensional quantum system 
must be of Lindblad form if it is to be physical. B 

In contrast, the converse question remained open. For the case of a single 
CPT map, we will refer to the question of deciding whether it is a member of 
a completely positive semi-group as the Markovianity problem, since CPT maps 
that are generated by a Lindblad master equation are said to be Markovian^ The 
main result of this work is a complexity-theoretic answer to the Markovianity 
problem (which will be made more rigorous later): 

Theorem 1 The Markovianity problem is NP-hard. 

*For subtleties of the problem of finding the most general form of a generator in infinite- 
dimensional quantum systems, see Ref. |0]. 

^^Note that this term is not used consistently throughout the literature. Here, we stick to 
the standard use of the term Markovian in the mathematical physics literature to mean the 
time-homogeneous Markovianity problem, in which the master equation is assumed to be time- 
independent. Sometimes, in particular in the context of condensed-matter physics, master equa- 
tions are also referred to as being Markovian if they are of Lindblad form, but may be time- 
dependent. One could also adopt the established classical terminology and call the problem con- 
sidered in this work the quantum embedding problem. 
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"Hardness" here is the rigorous complexity-theoretic concept, which will be 
explained precisely below. It concerns the scaling of computational effort as a 
function of the size of the problem, i.e. as a function of the total amount of infor- 
mation required to specify the CPT map. But a more refined analysis can break 
down the overall problem size here into two components: the dimension of the 
system, and the precision to which the CPT map is specified. We will analyse 
the complexity of the Markovianity problem with respect to both these parame- 
ters, and show that the NP-hardness is a consequence of scaling of the dimension. 
We will also show — hinted at already in Ref. [|7|] — that for di fixed dimension, the 
Markovianity problem can be decided efficiently in the precision. Thus, though 
the problem in general is (very likely) intractableEi in practical contexts arising 
in realistic experiments, where the dimension is invariably small, the question of 
whether a given CPT map is consistent with Markovian dynamics can be tested 
efficiently from a single snapshot in time. We will give an explicit algorithm in 
this case, along with a careful analysis of its scaling. 

Theorem 2 For any fixed physical dimension the Markovianity problem can be 
solved in a run-time that scales polynomially (both in the number of digits to 
which the entries of the CPT map are specified, and the precision to which the 
answer should be given). 

1.2 The Classical Problem 

Just as CPT maps and master equations provide the discrete- and continuous-time 
descriptions of dynamics in the quantum setting, stochastic maps and continuous- 
time Markov processes play the precisely analogous role in the classical setting. 
The analogous question to the Markovianity problem is, then, to decide whether a 
given stochastic map can be generated by a homogeneous continuous-time Markov 
process. This is known as the embedding problem for stochastic matrices, and it 
has an even longerpedigree than the quantum problem. It was originally posed as 
far back as 1937 [SI], and has been the subject of repeated investigation over the 
many intervening decades |@,[i^fl2]. Surprisingly, perhaps, the general embed- 
ding problem has remained open lll2ll . until now. 

Although there is a sense in which the classical embedding problem can be 
viewed as a special case of the quantum Markovianity problem, mathematically 
the two are inequivalent: a result concerning one does not necessarily imply any- 
thing about the other. However, it turns out that very similar techniques can be 
used to tackle both problems, allowing us to also show that: 

*Indeed, we will later extend Theorem[l]to prove full equivalence between solving the general 
Markovianity problem and solving the (in)famous P=NP problem. 
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Theorem 3 The embedding problem is NP-hard. 



This finally resolves the long-standing embedding problem, in the sense that 
no efficiently computable (polynomial-time) criterion can exist unless P=NP, and 
conversely the existence of any such efficiently computable criterion would imply 
P=NP. Rather than duplicating everything for the classical case, we will focus on 
the somewhat more complicated quantum problem, and then point out how the 
results can be adapted to the older classical embeddin g pr oblem. A more detailed 
exposition of the classical result can be found in Ref. lll3n . 



1.3 Implications for Physics 

The Markovianity and embedding problems are not only of mathematical interest. 
They are also crucial problems in physics. What is the best possible measurement 
data that an experimentalist could conceivably gather about a system's dynamics? 
They could, for example, repeatedly prepare the system in any desired initial state, 
allow it to evolve for some period of time, and then perform any desired measure- 
ment. In fact, by choosing a tomographically complete bases of initial states and 
measurements, and carrying out this procedure only a finite number of times, it 
is already possible to reconstruct a complete "snapshot" of the system dynamics 
at any particular time to arbitrary accuracy. In the quantum setting, this is quan- 
tum process tomography JH], but the general principle obviously applies equally 
well in the classical setting. Remarkably, thanks to the dramatic progress in ex- 
perimental control and manipulation of quantum systems over recent years, this is 
no longer a theoretical pipe-dream even for quantum systems. Full quantum pro- 
cess tomography is now routinely carried out in many different physical systems. 



solid-state devices [|22|] 



from NMR [[IJ, [15 Jlft Il7|] to trapped ions [UJ, 1190, from photons [|20L |21|], to 



A tomographic snapshot tells us everything there is to know about the evolu- 
tion at the time t when the snapshot was taken. Each snapshot gives us a dynamical 
map (a stochastic map in the classical setting, a CPT map in the quantum), which 
describes how any initial state of the system will evolve into a state at time t. All 
physical properties of the system at time t are then fully determined. In the quan- 
tum case, the expectation value of any physical observable M is given by Born's 
rule, whereas in the classical case it is given by a straight-forward average. Any 
physical measurement can therefore be viewed as an imperfect version of process 
tomography, since it gives partial information about the snapshot, and with suf- 
ficient measurement data the full snapshot can be reconstructed. Thus the most 
complete data that can be gathered about a system's dynamics consists of a set of 
snapshots, taken at different times during the evolution. 
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Given one or more snapshots, understanding the underlying physical processes 
typically amounts to reconstructing the system's dynamical equations and Liouvil- 
lian. Clearly, if we can find a set of Markovian dynamical equations describing the 
dynamics whenever these exist (and there is no a priori way of knowing whether 
they exist or not), we can also determine whether they existQ So understanding 
the physics governing an experimental system involves solving the Markovianity 
or embedding problem (or their generalisations to a family of CPT or stochastic 
maps, in the case of multiple snapshots). 

Thus the results of this work have a surprising implication for physics: no 
matter how much measurement data we might gather about the behaviour of a 
physical system, deducing its underlying Markovian dynamical equations — if the 
dynamics can be traced back to such a process — is fundamentally an intractable 
problem. And this extends to various closely related physical problems, such 
as finding the dynamical equation that best approximates the data, or testing a 
dynamical model against experimental data. 

Given their importance to physics, it is not surprising that numerous heuristic 
numerical techniques have been applied to tackle the Markovianity and embed- 
ding problems [| 1 q. uA l24l |25L 12611 . But these methods give no guarantee of find- 
ing the correct answer, or even any indication as to whether the correct answer has 
been found. One implication of the results of this work is that any such technique 
must necessarily eventually fail in the general case (although for fixed physical 
problem dimension, they can of course be very valuable). 

Finally, it may be worth mentioning that at the interface between physics and 
computer science a new field seems to be emerging in the literature, sometimes 
referred to as "Hamiltonian complexity". There, questions of hardness take centre 
stage in approximating ground state energies of local Hamiltonians, as occur in 
condensed-matter physics [|27{]. The question we address in this work, relating to 
the complexity of deciding a question about a dynamical property of a physical 
system, is partly inspired by issues raised in the above context, posing as it does 
the question of "Liouvillian complexity". 



1.4 Outline 

After introducing the necessary notation and recalling basic concepts in Section^, 
Section [s] develops a careful and rigorous formulation of the Markovianityprob- 
lem that will allow us to apply tools from complexity theory. Section |4| then 
gives a complexity-theoretic answer to the Markovianity problem: it is NP-hard. 

*Note that the problem of asking whether a given CPT map is approximately consistent with 
a master equation forming a dynamical semi-group is strictly speaking different from the question 
whether a given CPT map is exactly compatible with a master equation that approximately gives 
rise to a semi-group. 
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Technically, NP-hardness alone does not prove equivalence to P=NP; it could be 
that the Markovianity problem is much harder, so that even P=NP would not be 
enough to solve it. Section [sl completes the proof of equivalence by giving an ex- 
plicit algorithm that reduces the Markovianity problem to solving an NP-complete 
problem. In Section H we briefly explain how these proofs can be adapted to show 
that the classical embeddingproblem, too, is NP-hard (a fuller version appears in 
Ref. ilM)- Finally, Section [7| concludes with a discussion of the consequences of 
these results. 



2 Preliminaries 

In what follows, we will restrict our attention to finite-dimensional spaces and 
maps. It will be convenient to choose a concrete representation for the CPT maps. 
Since a CPT map £^ is a linear map on the d^-dimensional vector space TW^ of 
operators on a d-dimensional Hilbert space H, it can be represented by a x d'^- 
dimensional matrix E in the usual way. More explicitly, if we reshape the density 
matrix p as a vector ||p) with elements {i,j\\p) = pij in some orthonormal basis, 
E has matrix elements 



i?(Mm/) = (^'j||^(l^)(^l))- (1) 

The action of the channel S is then given by matrix multiplication, \\£{p)) = E\\p), 
and the composition £i o £2 of two channels £1 and £2 is given in this linear 
operator representation by the matrix product E1E2. 

The matrix E is also closely related to the more familiar Choi-Jamiolkowski 



state representation [|28L |29|] . given by the state a = {£ obtained by 

applying the channel to one half of the (unnormalised) maximally entangled state 
^ — 12i j K> ^) 0> j I ' defined in some fixed orthonormal product basis of Add® Aid 
(X being the identity map). Define the involution T by its action on this basis, 

\i,j){kj\^ = \i,k){jj\. (2) 

The Choi-Jamiolkowski and linear operator representations of £ are then related 
by E = a^. 

Completely positive semi-groups of CPT maps £t arise naturally as solutions 
of a Markovian quantum master equation describing the dynamics of the density 
matrix p (indeed, the continuous semi-group structure is essentially the only po s- 



sible one if we require the evolution to be describable at any time t > Il30l l31h): 



(3) 
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where L is the system's Liouvillian. If the solutions pit) = S{p{0)) are to be 
completely positive for alH > 0, then the Liouvillian C must be of Lindblad 
form i, 3: 



^ = Cip) = t[p,H] + Y,Ga,p{FapF; - (4) 

o,/3 



Here, H is Hermitian, and can be interpreted as the Hamiltonian of the system, 
G > and {Fq,} describe the decoherence processes, and {A, B}^ = AB + BA 
denotes the anti-commutator. A Markovian channel is one that is a member of 
such a semi-group, i.e. one that is generated by some C of the above form. 

It will again be convenient to represent the generator £ by a matrix, in the 
same way as for the channels. In the linear operator representation, a Markovian 
channel E = is one with a generator L such that e^* is CPT for all t > 0, and 
it is this that makes the linear operator representation convenient for our pu rpos es. 



It is not difficult to translate Eq. (141) into conditions on L (see Ref. Section 13.21 or 
Ref. [0]). 

The classical case is analogous. A stochastic map on a finite rf-dimensional 
state space is represented by a c? x (i-dimensional stochastic matrix P, which 
acts on d-dimensional probability vectors p. An embeddable stochastic matrix 
P = e*^ is then one with a generator Q such that e*^* is stochastic for all t > 0, i.e. 
Q defines a continuous-time Markov chain. The conditions on Q analogous to the 
Lindblad form of Eq. (0) (or, more precisely, to Lemma 0) are given by [32]: 



(i). Q,^j > , 

For consistency with the quantum notation, we are adopting the convention that 
probability distributions are column vectors, and maps act on them to the right. 
Thus the normalisation condition applies to the column-sums rather than the row- 
sums. Note, however, that this runs counter to the almost universal convention of 
using row-vectors in the probability theory literature. 



3 The Quantum Problem 

3.1 The Computational Markovianity Problem 

In order to apply tools from complexity theory to study the Markovianity problem, 
we will need to define the problem in such a way that the problem size — the 
amount of information needed to specify an instance of the problem — is well- 
defined. Even in the finite-dimensional case, this requires a little care. Since 
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CPT maps form a continuous set, there may exist Markovian and non-Markovian 
channels that are arbitrarily close (in any distance measure). Thus, to guarantee 
an unambiguous answer in all cases, the channel would need to be specified to 
infinite precision. 

There are essentially two standard ways of dealing with this in complexity the- 
ory. But, before we do so, it is instructive to first take a step back and recall some 
of physical motivation for the problem. In measuring a tomographic snapshot of a 
system's dynamics, there will always be some experimental error, and it makes lit- 
tle sense to require an answer that is more precise than this error. Mathematically, 
this suggests that we should consider the Markovianity problem solved if we can 
answer the question for some map that is a sufficiently close approximation to the 
one we were given. 

This is the intuitive idea behind the following weak-membership formulation 
of the Markovianity problem (cf. Ref. dH!], which uses a weak-membership for- 
mulation of the separability problem): 

Problem 4 (MARKOVIAN CHANNEL) 

Instance: {E, e): CPT map E, precision £ > 0. 
Question: Assert either that: 

• for some map E' with || £' || < e, there exists a map L' such that E' = e^' 
and e^'* is CPT for all t > 0; 

• for some CPT map E' with \\E' — E\\ < e, no such V exists. 



Here, we do not specify the matrix norm || . || in the problem definition. However, 
given the equivalence of norms on finite-dimensional spaces, with at most a poly- 
nomial prefactor in the dimension relating one norm to the other, we can leave the 
norm open for now. 

Note that, if E is close to the boundary of the set of Markovian channels, then 
it will be close to both Markovian and non-Markovian maps, and both assertions 
will be valid simultaneously. The physical interpretation in such a case would 
simply be that the snapshot was not measured to sufficient precision to allow an 
unambiguous answer. (There are other ways to formulate weak-membership prob- 
lems, but they are essentially equivalent ll34ll .) The other standard approach would 
be to restrict E to have rational entries, but this is less natural in the present con- 
text. 

Because there are cases in which both answers may be valid, the weak-mem- 
bership formulation of Markovian channel is not formally a decision prob- 
lem. This by definition rules it out of the decision class NP, where it by rights 
belongs. Whilst it is possible to reformulate it as a decision problem, we will 
avoid getting bogged down in these complexity theoretic technicalities here, and 
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accept that Markovian channel is not in NP. (See Ref. i^M for a discussion 
of similar issues in the context of the separability problem.) 

Markovian channel carries the implicit promise that E is a CPT map. It 
is natural to ask whether this affects the complexity of the problem. After all, if a 
tomographic snapshot is measured experimentally, it is very unlikely to be either 
precisely trace-preserving or completely positive. This motivates the definition of 
the following variant of the Markovianity problem, which accounts for non-CPT 
maps E: 

Problem 5 (MARKOVIAN MAP) 

Instance: {E, e): Map E, precision parameters e > e' > 0. 
Question: Assert either that: 

• for some map E' with \\E'—E\\ < e, there exists a map V such that E' = e^' 
and e^'* is CPT for all t > 0; 

• for some CPT map E' with — i^H < e, no such L' exists; 

• no CPT map E' exists for which \\E' — E\\ < e'. 

It is not difficult to see that the two problems, Markovian channel and 
Markovian map, are in fact equivalent. Clearly, Markovian channel is 
a special case of Markovian map, in which the third assertion is always false 
(E itself fulfils the requirements of one or other of the first two assertions). Con- 
versely, complete-positivity of a map E is equivalent to positivity of the Choi- 
Jamiolkowski matrix p = E^, and E is trace-preserving iff the partial trace of p is 
the identity matrix. So finding the closest CPT map E' to E is equivalent to find- 
ing the closest positive- semi-definite, suitable matrix p' to p. Indeed, if we fix the 
norm in Markovian map to be the Frobenius norrrE ||A||f := (^ij ^XjY^'^^ 
then not only do we have — -EHf = ||p' — p||f, but also, if we minimise 
Hp' ~ pIIf subject to the above semi-definite constraints, the objective function 
becomes a convex quadratic form. The problem can therefore be transformed into 



a semi-definite program using standard techniques |135D, allowing it to be solved 
efficiently to give E' and 1 1 i5' — 1 1 p . (More precisely, we can compute a bound on 
ll-E' — -EIIf that can be made exponentially tight with only polynomial overhead.) 
Thus, either we will conclude that the third assertion is valid, or we will succeed 
in transforming the problem into a Markovian channel instance. This proves 
the following complexity-theoretic (Karp) equivalenceQ: 



*The Frobenius norm is convenient for two reasons: firstly, the square of the norm-distance 
11^ — is strictly convex; secondly, it is invariant under permutation of matrix elements, in 
particular \\A^\\y = ||^||f- 

^^Throughout this paper, we will only consider Karp-reductions — i.e. polynomial-time reduc- 
tions where only a single invocation of the oracle is allowed — and Karp-equivalence, the strongest 
forms of reduction and equivalence. 



10 



Theorem 6 Markovian map = Markovian channel. 

3.2 The Computational Lindblad Generator Problem 

It is not immediately clear how one would go about solving a Markovian chan- 
nel or Markovian map instance. In order to answer this, we will need to es- 
tablish certain properties of the generators L of Markovian maps E = e^*. We 
will call such L Lindblad generators. The following Lemma is taken directly 
from Ref. which in turn is a slight modification of the argument given in 
Ref. [0], and gives an efficient criterion for deciding whether or not L generates a 
one-parameter CPT semi-group, i.e. whether it is of Lindblad form. 

Lemma 7 A map L is a Lindblad generator iff all of the following hold: 

( i) . is Hermitian. 

(ii) . L fulfils the normalisation {uj\ L = 0, where the maximally entangled 

state vector \uj) = ^ . \i, i) / \fd is expressed in the same basis in which 
the involution V is defined. 

( Hi). L satisfies 

{l-u)L^{l-uj) >0 (5) 

where u = \uj) {uj\. 

Maps satisfying Eq. (H) are called conditionally completely positive (ccp). 

We can assume without loss of generality that the matrix in a Markovian 
MAP or Markovian channel instance is diagonali sable (with respect to sim- 
ilarity transforms), non-degenerate, and full-rank. (Such matrices are dense in 
the set of all matrices, so we can always replace E with a neighbouring map that 
has these properties, and decrease e (keeping e' fixed in the case of Markovian 
map) such that the outcome is unchanged.) The Jordan decomposition of a diago- 
nalisable channel has the form 

r c 

where r labels the real eigenvalues, c the complex ones, and \rk) {lk\ are orthonor- 
mal (but typically not self-adjoint) spectral projectors formed from the left and 
right eigenvectors {lk\ and jr^) of E associated with the same eigenvalue A^. The 
fact that the eigenvalues come in conjugate pairs and that the corresponding spec- 
tral projectors are related via the "flip" operation, 

^(^^iJ N'J)) = ^^ij (7) 
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extended to operators as 

^{^(^{iJ),ik,i)\hj){k,l\^ = ^c^ij)Xk,i)\j,i) {k,l\ , (8) 

is a straightforward consequence of Hermiticity of CPT maps. It is easy to show 
that all CPT maps are necessarily Hermitian. 

Inverting the relationship E = e^, we obtain a generator L = \ogE from 
any channel E, where the matrix logarithm is defined via the logarithm of the 
eigenvalues. Of course, the logarithm is not unique. It has a countable infinity of 
branches, since the phase of each eigenvalue is only determined modulo 27r. E is 
Markovian iff there exists some branch of the logarithm that has Lindblad form, 
i.e. that satisfies Lemmal?!. So, to check if a channel is Markovian, we must check 
whether any branch of its logarithm has Lindblad form. 

Some of the branches can be ruled out immediately, using the condition that 
Lindblad generators must also be Hermitian maps (Condition (i) from Lemmalv]), 



which imposes that eigenvalues come in conjugate pairs. The remaining set of 
possible Lindblad generators for E can be parametrised by 

Lm := log E = Lo + 2m Y,mc{\lc){rc\ -¥{%){r,\)) =Lo + ^meAe, (9) 

c c 

where Lq is any fixed branch of the logarithm, e.g. the principle branch (defined by 
taking the principle branch in the logarithm of each eigenvalue), and each branch 
is characterised by a set of at most (f/2 integers uic (one for each pair of complex 
eigenvalues). We introduce the matrices Ac, defined by 

Ac:=2m{\Q{rc\-Fi\Q{rc\)) (10) 

for notational convenience. 

The Ac are fully determined by Lq, or, equivalently, by E. The following 
lemma summarises those properties of Ac and Lq that are easy to check, and fol- 
lows immediately from the first two conditions of Lemmalv] and Eqs. (@) and (fiol ): 



Lemma 8 If = Lq + J2c ^c^c parametrise the logarithms of a CPT map E 
as in Eq. (@), then Lq and Ac necessarily satisfy the following properties: 

( i) . Lq and Ac are simultaneously diagonalisable. 

(ii) . Ac are mutually orthogonal, rank-2 matrices with non-zero eigenvalues 

±2iTi. 

(Hi). Lq and Ac satisfy the normalisation {uj\ Lq = {uj\ Ac = 0. 
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(iv) . The two eigenvalues of Lq corresponding to the non-zero eigenvalues of 

any A^form a conjugate pair. 

(v) . The right and left eigenvectors |ri 2) and (/i 2I associated with a conju- 

gate pair of eigenvalues are relatedby \r2) = F(|ri)) and (/2I = F((/i|). 

The last two properties of pairs of eigenvalues and eigenvectors can be stated 
more concisely as: 

( iv). Lq and are Hermitian matrices. 

Together with the ccp condition of Lemma 0, 

(1 - u)Ll{l - to) + ^me{l - uj)Al{l - iu) > 0, (11) 

c 

this gives a criterion for deciding whether = Lq + rricAc generates a CPT 
map. Note that it is possible for to be ccp even if Lq is not. 

The characterisation of Lindblad generators in Lemma motivates the defini- 
tion of a new weak-membership problem: 

Problem 9 (LINDBLAD GENERATOR) 

Instance: {Lq, 6): Map Lq, precision 6. 

Promise: There exists a map Lq with \\Lo — Lq\\ < f{S) such that e^o is a quantum 
channel. (f{S) is a strictly increasing function of 5 which will be specified later ) 
Question: Assert either that: 

• for some map Lq with \\Lq — Ln\\ < 6, there exists a set of integers {nic} 
such that L'^^ as defined in Eq. (|a) satisfies Lemma 0,' 

• for some map Lq where e^'o is a quantum channel and ||Lq — Lo|| < 5, no 
such L' exists. 



The bound f{6) in the promise will be a somewhat complicated monotonically 
increasing function of 5 whose definition we defer until later (see Theorem Il5r ). 
when it will make more sense. But, essentially, the promise guarantees that Lq is 
close to the generator of some CPT map. This definition of Lindblad genera- 
tor might appear somewhat arbitrary. And indeed it would be, were we interested 
in the problem of deciding Lindblad form per se. (In that case, it would make 
more sense to replace the promise by an extra assertion, analogous to the third as- 
sertion of Markovian map.) But we will only use Lindblad generator as 
a stepping-stone to results concerning Markovian channel and Markovian 
MAP, and the above definition fulfils this purpose. In a slight abuse of terminology. 
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we will also refer to maps Lq for which there exists an L„i satisfying Lemma Iv] as 
Lindblad generators, even if Lq itself is not of Lindblad form. 

The preceding discussion suggests that Lindblad generator and 
Markovian map are equivalent. Clearly, the map E = is Markovian iff 
there exists at least one Lm satisfying LemmaQ- However, a little care is required 
in order to show that the reductions in both directions can be performed efficiently. 
In particular, we must show that appropriate precision parameters e and S can be 
computed efficiently, as well as accounting for the fact that the exponential and 
logarithm can not be computed to infinite precision. This will require strong con- 
tinuity properties of the matrix exponential and logarithm, and whilst these are 
easily established in the case of the exponential, they are somewhat more compli- 
cated to establish for the logarithm^ 

A proof of Lipschitz continuity of the exponential can be found in standard 
texts (see e.g. Ref. fsv'. Corollary 6.2.32]). 

Lemma 10 For any matrices A and B and any matrix norm || . || 

lle^ - e^ll < exp(||A||) exp(p - B\\) \\A - B\\ . (12) 



For the logarithm, we will need the following definition and theorems from Refs. [|38|] 



and [13911 ■ 



Definition 11 For closed linear operators A,B on a Banach space, define 

d{A, B) = max[5(A B), 6{B, A)], (13) 
6i{A,B) = sup 6{XA,XB), (14) 

0<A<1 

di{A, B) = max[5i(A B), 6i{B, A)], (15) 
(taken directly from Refs. [3^ 3^/. following the notation of Ref [39]). S{A, B) is 



Kato's 6 measure IV.^2.4]. 



t 



Note that none of these measures obey the triangle inequality, so none are proper 
distance measures (though they can readily be turned into such; see Ref. |38L 



*Ref. 113611 contains a nice discussion that gives some insight into why this should be. 
'^The distance-like measure d (which Kato calls 6) goes variously by the names "gap", "aper- 
ture" or "opening". Here, 

d{A, B) ^ supdist((x, Ax), G{B)), (16) 

X 

where G{B) is the graph of B, and the supremum is taken over all x in the domain of A, nor- 
malised such that ||x^|| + ||v4x|p ~ 1. This distance-like measure generates the correspondingly 
named topology. This topology can equivalently be defined as the standard graph topology on the 
graphs of the operators. 
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IV.§2.2,2.4]). The following theorem shows that, on bounded operators, the topol- 
ogy generated by 6 is equivalent to the norm topology of the Banach space (see 138, 
§IV, Theorems 2.13 and 2.14]). 

Theorem 12 If A and B are bounded operators on a Banach space with norm 
||.||, then 

d{A,B)<\\A-B\\ (17) 
and, if in addition d{A, B) < {1 + ||y4|p)^/^, 

\\A-B\\<^^±Mf^^^^. (18) 

" 1- (1+ pf)V25(A,5) 

Continuity of the logarithm can now be stated in terms of the distance-like 
measures of Definition IJ. (see lliol Theorem 3.1]). 

Theorem 13 If A,B E ^i(M) are operators on a Banach space with norm \\.\\, 
then forM>0 

d,{\ogA,\ogB) < 134(1 + M2)5i(A,5), (19) 

where ^ = {A \ domA dense} and 

^i(M) = {Ae^\Xe p{A) and{l-X) \\R{X,A)\\ < M for X < 0} (20) 

are subsets of operators on the Banach space, R{X, A) is the resolvent of A, and 
p{A) its resolvent set. 

For the case of finite-dimensional Hilbert spaces that we are concerned with 
here, ^i{M) becomes to the set of complex matrices whose eigenvalues do not 
lie on or close to the negative real axis. This amounts to taking the branch-cut of 
the logarithm to be along that axis. (Since this rules out zero eigenvalues, these 
matrices are also necessarily non- singular.) 

Because we defined our computational problems in terms of norm-distance, 
rather than the distance-like measures of Definition [uJ, we need to transform The- 
orem 



13 into a statement about norm-distance. 



Corollary 14 If A,B are bounded operators on a Banach space with norm 
and ifkA, kB E ^i(M) with 



k = min 

then 



1, (1342(1 + M)^\\A - Bf - ||Af ) 



2\l/2' 



(21) 



I log A — log -B II 

< 134A;(1 + M^) (1 + k\\A\\ + k\\A - B\\{1 + k'^\\Afy/'^) \\A - B\\ . (22) 
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Proof Assume first that d{\ogA, log_B) < (1 + || logAp)^/^, so that the condi- 
tion of Theorem [ij holds and Eq. (Il8[) is valid. From Definition [ill and rearrang- 
ing Eq. (|l8l) . we have 

di{\ogA,\ogB) > 6i{\ogB,\ogA) = sup 5(A log 5, A log A) 

0<A<1 



> (5(log5,logA) > 



I log A — log B I 



\A\ 



\A-B\\ (1 



\l/2 



and 



Si{A,B)= sup 5{\A,\B)< sup rf(Av4, A5) 

0<A<1 0<A<1 



< sup \\\A-\B\ 

0<A<1 



\A-B\ 



(23) 



(24) 



Using these inequalities in Theorem 1 131 gives Eq. (1221) of the Corollary with k = 1, 



under the assumption that c/(log A, log i?) obeys the condition of Theorem ll 3 



Otherwise, we can rescale A and B until they do obey the condition. Let 



< A; < (1342(1 + M^WA - 5f - ||Af ) 



-1/2 



(25) 



Then, using Eq. (1241) and Theorem! 13 



d{\og{kA),\og{kB)) < di{\og{kA),hg{kB)) < 13A{1 + M^)6i{kA, kB) 
< 134|A;|(1 + M^)\\A - B\\ < (1 + 

= (i + \\kAev/\ 



so d(\og{kA),log{kB)^ does satisfy the condition of Theorem 1 131 and by the 
preceding argument Eq. (|22|) applies to || log(A;y4) — log(A;i?)||. But 



(26) 
□ 



II log(M) - log{kB)\\ = II logA + log(A;l) - log 5 - log(fcl)|| 

= ||logA-log5||, 

which completes the proof. 



Note that if A or 5 happens to have an eigenvalue on the negative real axis, we 
can always rotate the branch-cut, or equivalently the eigenvalues. Multiplying by 
a scalar root of unity z rotates the eigenvalues away from the real axis, without 
changing the bound in Corollary 1 14 || log{zA) — log(zi?)|| = || log A — log i?||, 
but \\zA- zB\\ = \\A- B\\. 

We are now in a position to prove the main results of this section. 



Theorem 15 Markovian map > Lindblad generator. 
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Proof Assume first that we are given an instance {Lq, 6) of Lindblad GENER- 
ATOR that is unambiguous, i.e. either all neighbouring generators of channels are 
Lindblad generators, or none are. In that case we know that one or other of the 
assertions is valid, but not both. Now, using Corollary [l4|, we can calculate (effi- 
ciently) an e such that for \ogE = Lq, log£" = Lq, and Hi? — _E"|| < e, we have 
II log E — log E'W < 5. (Indeed, it is not difficult to solve Eq. (1221) for e and obtain 



is con- 

e 



an explicit expression.) Then the pre-image of an e-haW around E 
tained within the (5-ball around Lq (as illustrated in Fig.[l]). Since a map E 
is Markovian iff Lq is a Lindblad generator, and we are assuming the Lindblad 
GENERATOR instance is unambiguous, any channels within this s-ba\\ must either 
all be Markovian or all be non-Markovian. 




Figure 1: The pre-image of an e-ball around E = is contained within a (5-ball around Lq. If 
E is within e/3of E, then everything within a 2£/3-ball around E is with the e-ball around E. 



To deal with the fact that E = can not be calculated to infinite precision, 
let E be the exponential of Lq calculated to within precision e/3 (which can be 
done efficiently [140]); i.e. ||E - i?|| < e/3. If E' is within a 2£:/3-ball around 
E, we have \\E' — E\\ < e. Therefore, assuming for the moment that there ex- 
ists some channel within this ball (i.e. assuming its third assertion is not valid), 
the Markovian map instance {E,2e/?,,e') with any e' < 2e/?, will return its 
first (second) assertion iff the first (second) assertion of the original LINDBLAD 
GENERATOR instance was valid (always under the assumption that the original 
Lindblad generator instance was unambiguous). This is illustrated in Fig.Q. 

We must now justify the assumption that the third assertion of the MARKO- 
VIAN MAP instance {E, 2£/3, e') is always false. Recall that the Lindblad gen- 
erator promise guarantees existence of a generator Lq of a quantum channel 
within an /(5)-ball around Lq. For the assumption to be justified, this must im- 
ply existence of at least one quantum channel within an e'-ball around E. We now 



take f{5) to be defined implicitly using Lemma llOL such that for ||Lo — Lq|| < f{5) 



we have e 



^0 _ g^o I 



< e/3. (Once again, substituting the explicit expression for 
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e into Eq. (1221) and solving for f{5) would give an explicit definition for the latter, 
if so desired.) Then — < 2£/3, so that E' fulfils the requirements with 
e' = 2e/3. Figure Q illustrates this. 




Figure 2: Everything within an /((5)-ball around Lq is mapped into an e/3-ball around E, which 
itself is contained within a 2e/3-ball around E. (See also Fig.[ll) 

Finally, it remains to consider the case of LiNDBLAD GENERATOR instances 
that are ambiguous; i.e. there exist generators of both Markovian and non-Markovian 
channels within a (5-ball around Lq. In that case, the Markovian map instance 
{E,2e/3,e' = 2e/3) could return either assertion. But the original Lindblad 
GENERATOR instance is also allowed to return either assertion in this case, which 
completes the proof of the reduction. □ 

Theorem 16 Lindblad generator > Markovian channel. 



Proof The reduction from Markovian channel to Lindblad generator 



is very similar to the proof of Theorem 1 15L reversing the roles of LemmallOl and 
Corollary [l4j. The Lindblad generator promise is automatically fulfilled, 
since Lq = log E is itself necessarily a generator of a quantum channel (namely, 
E). □ 

Together, Theorems [6, 15 and 16 imply the following corollary: 



Corollary 17 Lindblad generator 

CHANNEL. 



Markovian map = Markovian 



4 NP-hardness 



We are now in a position to consider the computational complexity of the prob- 
lems defined in the previous sections. Although the ccp condition of Eq. dsj) is an 
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integer semi-definite program, and it is well known that even linear integer pro- 
gramming is NP-complete, this by no means proves that LiNDBLAD GENERATOR 
is NP-hard. Linear programming is the special case of semi-definite program- 
ming in which the coefficient matrices are diagonal. But the matrices Lq and Ac 
in a LiNDBLAD GENERATOR instance must satisfy a number of highly non-trivial 
constraints, as listed in Lemmajs], which certainly cannot be satisfied by diagonal 
matrices. Instead, our approach will be to restrict to a special case of LiNDBLAD 
GENERATOR, for which the relation between Lq and Lq is somewhat easier to 
analyse, then show that this special case can be used to encode 1-IN-3SAT, a 
standard NP-complete satisfiability problem, simpler even than its better-known 
cousin 3SAT in that it does not require any boolean negation^ 

Problem 18 (l-in-3SAT) 

Instance: [n^^nc): boolean variables; nc clauses each with exactly 3 vari- 
ables. 

Question: Is there a truth assignment of the variables such that each clause con- 
tains exactly one true variable ? 

1-IN-3SAT can be transformed into a set of simultaneous linear integer in- 
equalities in the standard way. Identify each boolean variable with an integer 
variable rric, and identify the values 1 and with "true" and "false". For each rric, 
write the inequalities 

1 7 

rric > --, -rric > --, (27) 

2 D 

and for each 1-IN-3SAT clause involving variables i, j and k, write the following 
inequalities: 

1 3 

rrii + rrij + rrik > -rrii - mj - rrik > --. (28) 

The non-integer constants are chosen for later convenience. These inequalities are 
satisfied for integers exactly if a single rrij is equal to one and the others are all 
zero. 

We now restrict Lq and to have the following special forms: 

Lq = ^Q^,j \hj){hj \ , (29) 

Ac = 271 J2Blj\^,^){J,J\, (30) 



*Note that the use of the term l-in-3SAT is not entirely consistent in the Uterature. Here we 



mean the variant that does not involve any negation, as originally formulated in Ref. 114 111 . 
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with 



X ® 1 : 7 1® 



•-r-"-r 



1 1\ fk + \r Xr 



v.vr«f. 11 (31) 



_ c c 

c 



A; 
A; 



{xj,} and {vc,Vc'} are two complete sets of mutually-orthogonal, real vectors, 
whilst k and A,- are real. Note that Q and are normal matrices, as are Lq 
and Ac. Since [Ivo,v4|j = 0, the {Lm = Lq + Xlc^^c^pl are also normal. The 
factor of 2n in Eq. (30) is for later convenience. Figures [j and give a graphical 



representation of the structure of Lq and A^.. 

It is a simple matter to verify that the properties required by Lemma [s] are 



indeed satisfied by the forms given in Eqs. (|29f) - (|32l) . as long as 

w^Q = 0, (33) 

and P = PT is Hermitian, w = (1, 1, . . .A)'^/^/d. Here, Q is a d x (i-matrix. 
Furthermore, the ccp condition of Lemma [Zl reduces to the pair of conditions 

271 Bl, rric + > 0, j, (34a) 

c 

(1 - ww^)K{l - ww^) > 0, (34b) 

where K denotes the d x rf-dimensional matrix with diagonal elements i^j j = Qj.i 
and off-diagonal elements Kij^j = Pij. 



We encode the 1-IN-3SAT inequalities of Eqs. (1271 ) and (12 81) by writing them 
directly into the {vc}. We associate a single Vc to each boolean variable of the 
problem. For each clause /, write a "1" in the Tth element of the three Vc's cor- 
responding to the variables appearing in that clause, and write a "0" in the same 
element of all the other Vc. Since there are nc clauses in total, at the end of this 
process the vectors each have nc elements. Now for each Vc, write a "1" in its 
nc + c'th element, writing a "0" in the corresponding element of all the other 
vectors. So far, we have defined the first nc + n^ elements of the vectors. Fi- 
nally, extend the vectors so that they are mutually orthogonal and all have the 
same Euclidean norm v^v^. This can always be done, and will require at most 
a further n^ elements, producing vectors with at most nc + 2nv elements. This 
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7 




Figure 3: The structure of Lq from Eq. (1291) is most apparent if we reorder the rows and columns so 
that all the (j, i), {j, j) elements are in the top, left corner. We can then think of Lq — Q ® diag P 
as being composed of a matrix Q and a vector P. 



( ^1,1 Bl-^ ■ ■ A 



^2,1 



^3,1 



V 



B: 



2,2 



B. 



2,3 



B: 



3,2 



B 



3,3 



■■■/ 




0/ 



Figure 4: Reordered in the same way, Ac from Eq. (1301) is composed of just a matrix part: Ac = 
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procedure encodes the coefficients for tlie 1-IN-3SAT inequalities into some of 
the on-diagonal 4x4 blocks of the B^. Specifically, if we imagine colouring in 
a chess-board pattern (starting with a "white square" in the top-leftmost element), 
then the coefficients for one inequality are duplicated in all the "black squares" of 
one 4x4 block (see Fig.ll). 

Colouring Q in the same chess-board pattern, the contribution to its "black 



squares" from the first term of Eq. (13 11) is generated by the off-diagonal elements 



The dots emphasise that these entries will be specified subsequently. Since {x,.} 
and {\r} can be chosen freely, the first tensor factor in this expression is just the 
eigenvalue decomposition of an arbitrary real, symmetric matrix S. If we choose 
the first nc diagonal elements of S* to be 1/2, and choose the next diagonal 
elements of S to be 5/6 , the n it is straightforward to verify that the equations in 



the ccp condition of Eq. (|34ah corresponding to the "black squares" in on-diagonal 



4x4 blocks are exactly the 1-IN-3SAT inequalities of Eqs. (1271) and (|28r) (see 
Figs. and [si). Note that the off-diagonal elements of S are not specified yet. 

We have successfully encoded the correct coefficients and constants into cer- 
tain matrix elements of B'^ and Q . Bu t all the other elements of these matrices 



also generate inequalities via Eq. (|34af ). To "filter out" these unwanted inequali- 
ties, we choose the remaining diagonal elements and all off-diagonal elements of 
the symmetric matrix S to be large and positive, thereby ensuring all unwanted 
inequalities are slack. 



The matrices Ac from Eq. (1301) automatically satisfy the normalisation con- 
dition of Lemma S, but Lq, as constructed so far, will not. We use the "white 
squares" of Q (see Figs. and [sl), generated by the diagonal elements in the third 
tensor factors of Eq. (13 lb . to renormalise the column sums to zero. Recall that both 
{xr} and {vc, Vc'} are complete sets of mutually orthogonal vectors. Rearranging 
Eq. isil) . Q is therefore given by 

Now, the only requirement on the off-diagonal elements of S is that they be suf- 



ficiently positive. Also, from the form of Eq. (|37[) . the columns in any individual 
4x4 block of Q sum to the same value. Thus, by adjusting the elements of S, we 
can ensure that all columns of Q — kl sum to the same positive value, which we 
call a. Choosing k = —a, the negative on-diagonal element in each column (gen- 
erated by the kl term) will cancel the positive contribution from the off-diagonal 
elements, thereby satisfying the normalisation condition, as required. 
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B\B\B' 



□ 



V 



Figure 5: If the n'th 1-IN-3SAT clause involves variables i, j, fc, the construction encodes the 
coefficients from the inequality of Eqs. (l28h into the rt'th on-diagonal 4x4 block of 5% and 
B'^ . All other B'^ corresponding to variables that do not appear in that clause will have zeros in 
that particular block. 




Figure 6: Each B^ contains a unique block of non-zero entries in the second set of on-diagonal 
4x4 blocks, corresponding to the 1 -IN-3S AT boolean constraints of Eqs. (l27h . 
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Q 



\ 



\ 



J 



Figure 7: The first set of on-diagonal 4x4 blocks of Q contain the constants for the 1-IN-3SAT 
clause inequalities of Eqs. OSh . . . 



Q 




(36) 



Figure 8: . . . whilst the second set of on-diagonal 4x4 blocks of Q contain the constants for the 
1-IN-3SAT boolean inequalities of Eqs. (1271) . 
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Finally, we must ensure that the second cop condition of Eq. (l34bl) is always 
satisfied, for which we require a simple lemma. 



Lemma 19 If D > — cri is a diagonal d x d- dimensional matrix, then there exists 
a symmetric matrix P such that Pi^i = Ofor all i and 

(l-ww^)(L) + P)(l-ww^) >0, (38) 

where w = (1, 1, . . . , 1)^/ ^/d. 

Proof Choose P = a{l — ww^) + a(l — d)ww'^. Then the diagonal elements 
of P are 

Pi,i = a(^l-^^ +a{l-d)^ = 0, (39) 

and 

— WW ) , (40) 

which is positive semi-definite for a > a. □ 



The coefficients Pij in Eq. (|29r) can be chosen freely, since these coefficients 
play no role in either the normalisation or in encoding 1 -IN- 3 SAT, so the matrix 
P in the ccp condition of E g. (l34bl) can be chosen to be any matrix with zeros 



down the main diagonal. Eq. (l34bh is exactly of the form given in Lemma li9| with 



A,^ = Qi,^ (41) 

and choosing P accordingly ensures that it is always satisfied. 

In the discussion preceding the definition of Lindblad generator, we ar- 
gued that we need only consider non-singular, non-degenerate channels. Genera- 
tors of such channels are necessarily bounded and non-degenerate as well, and the 
proof of equivalence of LiNDBLAD GENERATOR and Markovian map, lead- 



ing to Theorem HJ, breaks down if these properties do not hold, since additional 
branches of the matrix logarithm arise: applying an arbitrary similarity transfor- 
mation to a degenerate Jordan block will give another logarithm. The matrix Lq 
we have constructed is clearly bounded, but it is highly degenerate. 

We will now slightly modify the above construction, removing the mentioned 
degeneracies. In fact, most of the degeneracies can easily be lifted by as large 
a margin as desired byperturbing suitable elements of Lq, without affecting the 



conditions of Lemma |8|. The only ones that require more care are degeneracies 



due to the final two terms of Eq. (13 11) . as some of those matrix elements were used 
to encode 1-IN-3SAT. 

It is not difficult to verify that rric will be constrained to the same set of integer 
values if the perturbation to any constant in the set of inequalities is less than 
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1/6 (the second inequality in Eqs. (l27b being the most sensitive). The constants 



are given directly by matrix elements of Lq, so we are free to lift the remaining 
degeneracies in Lq by perturbing each summand in the final two terms of Eq. (|3 lb 
by a different amount, as long as we ensure that no element of Lq is perturbed by 
more than 1/6. This can be achieved by perturbing each off-diagonal elemen|3 of 
the final tensor factor by a different integer multiple of 



9d\l 



(42) 



No element of Lq is then perturbed by more than 1/18 (this is deliberately stricter 
than necessary by a factor of three, for reasons that will become clearer later), and 
the minimum eigenvalue separation for the perturbed Lq is 2/{9d). 

By construction, Lq is a Lindblad generator iff the original 1-IN-3SAT in- 
stance was satisfiable, so we have achieved the first half of the reduction. It re- 
mains to choose a value of 6 such that this also holds for any ^in the 5-ball 



around Lq. As noted above, the inequalities in Eqs. (1271) and (I28h are insensi- 
tive to small perturbations. Specifically, one can verify that the set of feasible 
nic will be unchanged if each coefficient and constant (this time including zero 



coefficients, i.e. coefficients of variables that do not appear explicitly in Eqs. (|27|) 



and (l28|)) is perturbed by less than min[l/18(n^ + l),5/18(2n„ + 1)]. (Recall 
that we already perturbed the constants by (up to) 1/18 to lift eigenvalue degen- 
eracies. This bound is deliberately stronger by a factor of two than would appear 
to be necessary at this stage, but in any case it is certainly stronger than is strictly 
necessary.) 

The constants in the inequalities are given by matrix elements of Lq. If we 
choose the norm in Lindblad generator to be the loo norm, then is is sufficient 
to require 

< mm 



. ^ • (43) 

18(n„ + l)' 18(2n^ + r ^ 

The coefficients in the inequalities are given by matrix elements of which are 
formed from the eigenvectors of Lq. Thus, to bound perturbations of the coeffi- 
cients, we must bound perturbations of the eigenvectors in terms of the perturba- 



tion to Lq, which is less trivial. We will need the following result from Ref. [|42n . 
and a simple corollary. 

Lemma 20 Suppose A is a normal matrix, with E an arbitrary matrix of the same 
dimension. Let Q = (vi, Q2) be unitary, such that vi is an eigenvector of A, and 



*We avoid perturbing the diagonal elements, as that would make satisfying the normalisation 
condition far more difficult. 
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partition the matrix Q'^EQ conformally with Q'^AQ, so thaJ^' 



Q^AQ 



Ai 

^2,2 7 ' 



Q^EQ 



Ei^i Ei^2 

-£'2,1 -£'2,2 



(44) 



where {Ai} denote the eigenvalues of A, with Ai the eigenvalue associated with 
vi. Let 

(45) 



A = mill lAi — Ai 



|-£'1,i|If ^ I|-£'2,2|If 5 



where = ■ p is the Frobenius (or Hilbert-Schmidt) norm. IfA>0, 

and 

||-5'2,l||p ||-5'i,2||f ^ I 

A2 - 4' 



(46) 



then there exists a matrix P satisfying 



I^IIf<2' 



I -£'2,1 1 



(47) 



such that v' = (vi + Q2P){1 + P^P) a unit eigenvector of A + E (in the 

Frobenius norm). 

Proof This is a slight generalisation of Theorem 8.1.12 from Ref. or slight 
restriction of Theorem 4.11 from Ref. [42], to the case of normal A. □ 

Corollary 21 Suppose A is a normal matrix, with E an arbitrary matrix of the 
same dimension. If v is a unit (in Frobenius norm) eigenvector of A associated 
with a non-degenerate eigenvalue, and the requirements of Lemma \2(a are fulfilled, 
then there exists a unit eigenvector V of A + E such that 



|vvt - vVT||p < K \\E\\p, 



with 



K 



4(d||E||p + v/rf^A) 



A2 -4IIEI 



(48) 
(49) 



and A as defined in Lemma \2C . 



Proof From Lemma l20|, we have 

(vi + g2P)(vi + g2P)^ 



I ' 't 

V V ' 



vv 



1 + ptp 



vivj 



< 



2||v||F||g2||F+||P||F(||v|||+ 11^2111) 
1 - llPtPllF 



2v/d^ + d||P||F|| 
< -. — — ||P||f- 



1 



IPI|2 

KIIf 



(50) 
(51) 
(52) 



*Q'^ AQ must be of this form, as the Schur decomposition of a normal matrix is diagonal. 
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in which we have used Lemma 2.3.3 from Ref. fi43i1 to bound (l+P^p)-!^ and the 
fact that \\U\\f = \/d for any d x d unitary U. The result follows by substituting 
the bound on ||P||f from Lemma |20L and using ||-E'2,i||f ^ II-^||f- I— I 



Now, each Ac is a sum of two eigenprojectors, and Lq happens to be normal. 
Applying Corollary l2lL and using the fact that ||X||oo < ||-^||f, we see that it 
suffices to restrict 



S < min 

- 2K 



1 



18K, + 1)' 18(2r2, + 1^ 



(53) 



We must also satisfy the two requirements of Lemma |20|. Recalling that the mini- 
mum eigenvalue separation of Lq is 2/{9d), we see that it is sufficient to impose 



6 < 



1 



and 6 < 



mm 



Ai — Ao 



(54) 



Ad 18d' 

For Lq, satisfying the inequalities is equivalent to satisfying the ccp condition 
of Lemma 0. However, even choosing 5 to satisfy Eqs. (43), (53) and (54), this 
may no longer be the case for all Lq within the (5-ball around Lq. If the inequalities 
are infeasible, then at least one diagonal element of any (1 — uj)L'^(l — to) must 
be negative, and it is still the case that the ccp condition is violated (since non- 
negativity of the diagonal elements is a necessary condition for a matrix to be 
positive semi-definite). But if the inequalities can be satisfied, the most we can 
say is that all diagonal elements of (1 — c<j)L'J"(l — c<j) are lower-bounded by 1/18. 

Now 

~ (55) 



with < ??7c < 1 integer, and the A'^ are perturbations of Ac. The off-diagonal 
elements of the latter are zero. Therefore, we can control the magnitude of the off- 
diagonal elements of the n.^ different A'^ by applying Corollary |2l| again, whilst 
controlling the off-diagonal elements of Lq by restricting 5 directly, as before. 
Putting all this together, we see that imposing 



6 < 



18d 



and 6 < 



1 



32Knyd 



(56) 



ensures that the off-diagonal elements of any L'„^ are upper-bounded by 1 /{18d). 
However, this implies that (1 — u)L'^{l — u) is diagonally-dominant, which is 
sufficient to guarantee positive-semi-definiteness. 

Thus, if 5 > is chosen to satisfy Eqs. (1431) . (|53[) . (1541) and (|56h . then for 
any Lq within a 5-ball around Lq (in the /qo norm), satisfying the ccp condition is 
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equivalent to satisfying the original 1-IN-3SAT problem. Comparing the bounds 
on S from Eqs. (|43|) . (|53r) . (|54l) and (l56h . we have 



6 = 0{n~\nc + 2n,y'). (57) 

Sufficient bounds for any other norm can easily be obtained via equivalence of 
norms in finite-dimensional spaces, and will at worst introduce additional factors 
polynomial in the dimension (i.e. polynomial in n.y and nc). The fact that 6^^ 
has to scale only polynomially makes our results far more compelling; it cannot 
be claimed that they are a consequence of unreasonable precision demands. Even 
this mild scaling may be an artifact of the construction, and it would be interesting 
to know if a construction exists in which 5 can be taken constant. 

Finally, it remains to consider the promise required in the definition of LlND- 
BLAD GENERATOR. Assume that the promise is not satisfied. In that case, Lq 
itself clearly cannot be the generator of a CPT map. But Lq satisfies the Hermitic- 
ity and normalisation requirements of Lemmajv] by construction, so it must fail to 
satisfy the ccp condition. Thus failing to satisfy the promise implies that the 1-lN- 
3SAT instance must have been unsatisfiable. Combining the arguments used in 
the proofs of Theorems @ and 15 gives an efficient procedure for deciding whether 



(Lo,5) satisfies the promise, thereby deciding these instances. This leaves only 
instances that do satisfy the promise, as required. 

We have reduced satisfiable instances of 1-IN-3SAT to LiNDBLAD GENER- 
ATOR instances that return the first assertion, and have either efficiently decided 
unsatisfiable instances of 1-IN-3SAT (because they fail to satisfy the promisefl 
or reduced them to Lindblad generator instances that return the second as- 
sertion. This completes the proof that 

Lemma 22 1-IN-3SAT < Lindblad generator 

and, since 1-IN-3SAT is NP-complete, 

Corollary 23 Lindblad generator is NP-hard. 

But, by the chain of equivalences proven in Theorem @ and Corollary 17, this 



implies our main result: 

Theorem 24 Markovian channel and Markovian map are NP-hard. 



Theorem |24j tells us that the Markovianity problem is NP-hard. 

What of the more general question of determining whether a given family of 
maps are members of the same continuous, one-parameter, completely positive 



*It is amusing, but probably of no practical value, to note that this provides a new "gadget" for 
efficiently deciding certain non-satisfiable instances of 1-IN-3SAT. 
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semi-group? Formulated rigorously, this is a generalised version of Markovian 
MAP, in which a family of maps Et is given, along with their associated times t 
(up to some precision), and the answer should assert the existence or otherwise of 
a common Lindblad generator for all the maps up to precision £ > (or assert that 
at least one of the Et is not CPT up to precision e' > 0). 

A first trivial observation is that, since we know there exists a special case 
of this problem that is NP-hard, namely MARKOVIAN MAP itself, the general 
problem is automatically NP-hard. However, this leaves open the question of 
whether the complexity depends on the number of maps in the family. Recalling 
the physical motivation behind the problem, one might expect that, given more 
information about the dynamics (e.g. by taking many tomographic snapshots), the 
problem would become easier to resolve. 

In fact, in proving the NP-hardness of MARKOVIAN MAP, we have already 
done all the work necessary to prove NP-hardness of the general problem for any 
number of maps. Instead of computing a single map E = to reduce Lindblad 
GENERATOR to MARKOVIAN MAP, we Can compute a family of any number of 
maps Et = e^*. (To make this rigorous, the arguments of TheoremI 1 5l can straight- 
forwardly be extended to the case of a family of maps Et.) So the problem for an 
arbitrary (finite) number of maps is essentially no different to the problem for a 
single map, in particular as far the complexity is concerned. 

5 An Algorithm 

The NP-hardness proof of Section implies that we are unlikely to find an ef- 
ficient algorithm for solving the Markovianity problem. Nonetheless, there are 
two reasons to develop an algorithm for solving it, even though it will be ineffi- 
cient. The first reason is in some sense a technicality. We would like to prove 
that solving the Markovianity problem is equivalent to solving P=NP. That is, we 
want to show that (i) any efficient algorithm for solving the Markovianity prob- 
lem would imply P=NP, and conversely (i,i) ifP=NP then there exists an efficient 
algorithm for solving the Markovianity problem. NP-hardness proves (i). But 
the weak-membership formulations of the Markovianity problem (MARKOVIAN 
Channel/Map) are not technically members of the class NP, thus it is not clear 
whether proving P=NP would be sufficient to provide an efficient algorithm for 
solving them. Weak-membership problems do not belong to NP, for the simple 
reason that NP is a decision class, but weak-membership problems are not deci- 
sion problems since they have instances in which both "yes" and "no" answers are 
simultaneously valid. Giving an explicit algorithm for MARKOVIAN Channel 
which reduces to solving an NP-complete problem resolves this technicality. 
The second reason for developing an algorithm is that the NP-hardness proof 
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of Section requires the dimension to scale polynomially with the size of the 
1-IN-3SAT problem being encoded. So, although the general Markovianity prob- 
lem for CPT maps and embedding problem for stochastic matrices are NP-hard, it 
is interesting to ask how the complexity scales if the dimension is fixed (in which 
case the problem size scales only with the precision). By giving an explicit algo- 
rithm, we show that for fixed dimension the Markovianity problem can be solved 
efficiently, i.e. the complexity scales only polynomially with the precision. This 
is also the basis for the proposed measure of Markovianity in Ref. 0]. 

One motivation for considering the case of fixed dimension is current experi- 
mental limitations. A snapshot of a quantum evolution is measured by performing 
full quantum process tomography. Tomography of a rf-dimensional system re- 
quires measuring a total of d"^ — (P different expectation values iQ §8.4.2], and 
the expectation value of each observable must be estimated by averaging over 
many runs. The experimental overhead for all of this scales polynomially with 
the dimension of the system, but a polynomial scaling can still be prohibitive in 
practice! Current experiments can only perform full process tomography for sys- 
tems up to a few qubits, before the time required becomes exorbitant. It is quite 
reasonable in this context to regard dimension as a fixed parameter. 

Since Markovian map is equivalent to Markovian channel by Theo- 
rem 0, a Markovian map instance can be solved by first efficiently reducing 
it to Markovian channel, then solving the Markovian channel instance. 
We now describe an algorithm which solves MARKOVIAN CHANNEL in polyno- 
mial time for fixed dimension. (The present treatment presents a detailed and 
rigorous proof of the result already reported in Ref. [0]-) For convenience, we 
will take the matrix norm in the definition of Markovian channel to be the 
Frobenius norm ||.||fE1 It is not difficult to adapt this algorithm to the classical 
Embeddability problem. 

Algorithm 25 (MARKOVIAN CHANNEL) 
Input: {E, e): Quantum channel E, precision e. 
Output: One of the two assertions from Problem 0. 
1: Calculate approximations Lq and Ac to Lq = logE and Ac (cf. Lemma Iv]) to 
any precision k, so that ||Lo — Lo||f < nand \\Ac — Ac\\f < k,{Lo and Ac can 
be obtained by calculating the eigenvalues and eigenvectors of E). 
2: Calculate 6 by solving 

exp(^||Lo||F + M PJf) exp(^K + ^^^Se^ = e, (58) 

c 

where M depends polynomially on e (which is always possible, discussed in 
more detail below) and d is the dimension of E. 



*lt is straightforward to generalise these results to other norms. 
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3: Calculate approximations to the logarithms Aj of eigenvalues e^' of E, and to 
the eigenprojectors of E, to precision sufficient to ensure that 

i2d\\r-u\\i 



|ri)(/i| - ^Aj \ri){li\ 



< .,,3 ^ (59) 



S_ 

If ^ 2471 Md^i - uj\ 



\r~i){k\ - |r,)(/,|||^ < (60) 



I Ai — Aj I < min ^^^^^ — —. (61) 
jVfc 4 

4; Use the results to calculate Lq = J2i and the corresponding Ac (cf. 

Lemma M). 



5: Solve the following mixed integer semi-definite program, in integer variables 
rric and real variable t: 

minimise t 

subject to {l-uj)Lo{l-uj) + ^mc{l-uj)Ac{l-uj) + tl > 0. 

c 

if t < -5/{6d\\l- uj\\f) then 

return "Markovian" (P' assertion of ProblemI; 
else ift > 6/{Qd\\l- lu\\f) then 
9: return "non-Markovian" (2"'^ assertion of Problem 0). 
10: else ift < 5/(3rf||l -cu||f) then 
11: return "Markovian" (P' assertion of Problem^). 
12: end if 



To prove correctness of Algorithm |25L first note that, from lines [UtolH \\L 



^0 



-^o||f < 5/(12(i|| 1 — c<j||p). Also, ifmaxcmc < M, then from line [3] we have 

\\Lm - Lmh < \\Lo - LqWf + 27r^ Imdll \fi){ii\ - \ri){li\ ||f 



(62) 



6d\\l-ufp 



we will assume throughout the following that M is an upper bound on the values 
nic returned by the integer program of line[5l i.e. that maxc \mc\ < M < oo, an 
assumption that will be justified later. 

Now consider the three cases in lines [6] to [HJ To deal with the first two, we 



will need the following simple lemma (see e.g. Ref. rt44l Corollary 6.3.4]) 
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Lemma 26 Let A be normal, E be an arbitrary matrix. If X' is an eigenvalue of 
A + E, then there exists some eigenvalue X of A such that |A' — A| < ||-E||f- 

If t < — ^/(Grflll — cjIIf), then, from the definition of the integer program in line[5] 
of Algorithm I25I we know that all eigenvalues of (1 — — on) are greater 



than 5/{6d\\l ~ uj\\f). Also,^ from Eq. (l62l), - uj){L^ - Ll^){l - < 



S/{Qd\\ 1 — uj\\f)- Lemma l26l then implies that the minimum eigenvalue of (1 — 
uj)L^(l — uj) is non-negative, i.e. Lm is ccp. Lq is therefore a Lindblad generator 
by Lemma tZi thus the original channel E must itself be Markovian. Similarly, if 
t > 6/{6d\\l — lu\\f), then the minimum eigenvalue of any (1 — lu)L^^{1 — lu) 
is strictly negative. Thus all fail the ccp condition of Lemma [vi Lq is not a 
Lindblad generator, and the original channel E is non-Markovian. 



Dealing with the final case in line [10] of Algorithm l25| requires the following 
result: 

Lemma 27 If L is Hermitian and normalised (in the sense of Lemma^, and the 
minimum eigenvalue of {1 — uj)L^{l — uj) is bounded by Amin > then there 
exists a Lindblad generator L' such that — L||f < — u;||f, where d is 

the dimension of L. 

Proof Consider the map L' = L + e{du! — dl). Since L is Hermitian and nor- 
malised in the above sense, we have (L'^)t = L'^ and L' = 0, so these 
properties carry over to L'. But we also have 

(1 - Lj)L'^{l - cj) = (1 - u)L^{l -Lj) + e{l - cj)(l - d^uj){l - u) 

(63) 

= (1 - uj)L^{l -uj) + e{l - u). 

Since (1 — uj)L^{l — u) has support only on the orthogonal complement of \uj), 
and {1 — to) acts as identity on that subspace, the minimum eigenvalue of (1 — 
uj)L'^{l — u) is non-negative. Thus L' also satisfies the ccp condition, and, by 
Lemma 0, is a Lindblad generator. □ 

If t < 5/(3(i|| 1 — c^IIf), then the minimum eigenvalue of (1 — uj)L^{l — u) 



is greater than — 5/(3(i||l — c^Hf), thus Lemma l26l and Eq. (l62r) imply that the 



minimum eigenvalue of (1 — uj)L^{l — cu) is /ower-bounded by 

Amin > -6/{3d\\l-u\\F) -5/i6d\\l-uj\\F) = -(5/(2d||l -cu||f). (64) 

Applying Lemma[27| to L^ yields a Lindblad generator L' such that 1 1 L' — 1 1 f < 

d\\ 1 — uj\\F5/{d\\ 1 — u;||f) = S and, since L' is a Lindblad generator, E' = is 
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a Markovian channel. But, using Lemma llOL we have 

\\E' - E||f < ell^'"l'^el'^'-^'"ll^||L' - L^h 
<exp(||Lo||F + M^||A,||F)5e^ 



< exp (^IILoIIf + M J] ||i,||F^ exp (^k+^^^ S 



(65) 



(with the inequality in the penultimate line resulting from line[i|of Algorithm[25l — 
recall that there are at most d/2 matrices Ac — and the final equality from line[2l)- 
Therefore, E' is a Markovian channel within distance e of the original channel E, 
and the first assertion of Problem^ is valid. 



This proves correctness of Algorithm 125|. What of its run-time? All but a 
few steps can obviously be performed in polynomial-time. Recall that we are 
assuming, without loss of generality, that E is non-degenerate and non-singular, 
which, more rigorously stated, requires the condition number of E to be upper- 
bounded by some constant. The eigenvalue and eigenvector calculations of E in 



lines [3] and [H can therefore be done efficiently in and also the dimension [43, 
§7.2], with the eigenvalue and eigenvector condition numbers of E [43, §7.2.2-5] 
contributing a (possibly large) constant factor. 

A question arises in calculating A^. Lq is not necessarily a Hermitian map, 
so how can the eigenvalue pairs from which to form Ac (cf. Eq. (fiol)') be identi- 
fied? But Lq is Hermitian, and the bound on \Xi — Xi\ in line [3] ensures that the 
2||Aj — Aj||F-disc around A*, within which the conjugate partner of Aj must lie, 
is guaranteed to contain a single Aj, allowing approximately conjugate pairs of 
eigenvalues to be identified. 

The key step in the algorithm is the mixed integer semi-definite program in 



line[5l (If Algorithm l25l is adapted to solve the classical Embeddability prob- 



lem, this becomes a mixed linear integer program instead.) In a generalisation 



of a famous result by Lenstra [|45h for linear integer programming, Khachiyan 



and Porkolab proved that for any fixed number of variables, integer semi-definite 



feasibility problems can be solved in polynomial time 1461 14711 . In our case, fix- 
ing the number of variables corresponds to fixing the system's dimension. The 
integer semi-definite program can therefore be solved by applying the Khachiyan- 
Porkolab algorithm to the feasibility problem for given t, combined with binary 



search on t. From Corollary 1.3 of Ref. 114611 . the run-time of the Khachiyan- 
Porkolab part scales polynomially with the number of digits of precision to which 
the elements of the coefficient matrices are specified. But the coefficient matrices 
in our case are Lq and Ac, and their description size is independent of the precision 
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to which the original E was specified, depending only on the precision parameter 
e. So the run-time of the Khachiyan-Porkolab step scales polynomially in e^^, as 
required. 

We can now also justify the assumption that an upper bound maxc rric < M 
can be placed on the integers uic resulting from the integer program. Theorem 1.1 
of Ref. [46] proves that such a bound exists and, in the case of integer semi-definite 



programming (1461 Corollary 1.3]), that it scales as 

log max \mc\ = 2^(^') log/, (66) 

c 

where / is the maximum bit-length of the entries of the coefficient matrices Lq and 
Ac, and we have translated other parameters into our notation. Since we have al- 
ready argued that the size of the description of these matrices scales polynomially 
with e^^, this gives a bound M that scales as 

maximal =£(2°'''')'^« =M, (67) 

c 

i.e. polynomially in as claimed. 

Since the calculations in each line of Algorithml25l have run-times that scale at 
most polynomially in e^^, and are independent of the number of digits to which E 
was specified, the entire algorithm has run-time polynomial in the precision and 
independent of the size of the description of E. This, together with Theorem 0, 
proves the main practical result of this section: 

Theorem 28 For any fixed dimension, Markovian channel and 
Markovian map can be solved in a run-time that scales polynomially in both 
the problem size (the size of the description of the channel) and the precision pa- 
rameter e~^. 

It is worth remembering that proving an algorithm has polynomial run-time 
does not necessarily imply that it is the best algorithm to use in practice. In fact, 
considering the first few branches of the logarithm is often sufficient for practi- 
cally relevant cases. Indeed, it would be interesting to try to flesh out heuristics 
or a proof as to why this simple approach is so successful. If E is an experimen- 
tally measured tomographic snapshot, the truncation errors in computing log E, 



that Algorithm [251 expends much effort in accounting for, will, in all likelihood, 
be swamped by experimental error. It is probably reasonable to calculate Lq and 
Af. numerically, without worrying about numerical errors, and solve the resulting 
mixed integer semi-definite program using standard integer programming algo- 
rithms (which work well in practise even though their scaling may theoretically 
not be polynomial in the precision). If the t thus obtained is comparable to the es- 
timated error, the most reasonable conclusion is that the experimental data simply 
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are not precise enough to give any definitive answer. In fact, a more sophisticated 
answer is to quote the value of t itself, as it is (related to) a natural measure of 
"Markovianity". This is discussed in more detail in Ref. 



All the steps of Algorithm 1251 also scale efficiently with the dimension of E, 
apart from solving the mixed integer semi-definite program in line[5l Since integer 
semi-definite programming is in NP, this (together with Theorem @) proves the 
other main result of this section: 

Theorem 29 Solving Markovian Channel or Markovian Map is equiv- 
alent to solving P=NP: an efficient algorithm for MARKOVIAN CHANNEL or 
Markovian Map would imply P=NP; conversely, P=NP would imply existence 
of efficient algorithms for MARKOVIAN CHANNEL and Markovian Map. 



6 The Classical Problem 

The classical analogue of the Markovianity problem is called the embedding prob- 
lem, but it is much older, dating back to at least 1937 [8]. For a given stochastic 
matrix P, the problem is to determine whether or not P can be embedded into a 
continuous-time Markov chain, i.e. whether it is a member of a continuous-time, 
one-parameter semigroup of stochastic matrices. Equivalently, does there exist a 
generator Q such that P = and 6*5* is stochastic for all t > 0? 

Simple necessary and sufficient conditions can easily be derived for 2x2 
stochastic matrices (this result seems to originally have been reported by King- 
man |l48n . who attributes it to Kendall), progress has been made on the 3 x 3 
case i49|] . and certain properties are known for the general case |llll|48|,l50|]. How- 
ever, the problem still remains open in general [12]. Kingman showed \^ that 



the structure of the set of embeddable stochastic matrices must be quite complex: 
it consists of a number of pieces that is polynomial (in dimension), only one of 
which can be expressed algebraically. It is unclear what this implies about the 
complexity of the problem in the rigorous complexity-theoretic sense. The fact 
that the number of pieces is polynomial in the dimension might tentatively sug- 
gest that checking each piece one-by-one to see if it contains P would at least 
give a polynomial-time algorithm for solving the embedding problem, even if a 
simple condition for embeddability remains elusive. However, it is not clear how 
each piece can be checked. 

In order to discuss the complexity of the problem in a rigorous sense, it is 
necessary to formulate the embedding problem as a weak-membership problem, 
analogous to Markovian channel or Markovian map, for the same reasons 



discussed in Section l3jj in relation to the quantum problem: 
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Problem 30 (Embeddability) 

Instance: (P, e): Stochastic matrix P ; precision e > 0. 
Question: Assert either that: 

• for some matrix P' with ||P' — P|| < e, there exists a generator Q' such that 
P' = and * is stochastic for all t > 0; 

• for some stochastic matrix P' with \\P' — P\\ < e, no such Q' exists. 



Again, we could also formulate a variant analogous to Markovian map, which 
drops the requirement that the given P be stochastic. 

Now, stochastic maps are a special case of CPT maps in the following sense. 
The diagonal entries of a density matrix form a probability distribution, and every 
stochastic map can be extended to a CPT map whose action on the subspace of 
diagonal density matrices is the same as the action of the original stochastic map 
on the probability distribution formed by those diagonal elements. For example, 
we can take the composition of the CPT map that erases all off-diagonal elements 
of the density matrix, with the original stochastic map acting on the diagonal 
elements. 

However, it does not follow that NP-hardness of the quantum problem im- 
plies NP-hardness of the embedding problem, as that would require precisely 
the opposite: encoding a CPT map into a stochastic map. But nor would NP- 
hardness of the embedding problem imply NP-hardness of the Markovianity prob- 
lem, since the above argument showing that any stochastic map can be extended 
to a CPT map does not "preserve" embeddability (more precisely, it does not map 
the set of stochastic maps into the set of Markovian CPT maps, and the set of 
non-embeddable maps into the set of non-Markovian CPT maps). The embedding 
problem for stochastic matrices and the Markovianity problem for CPT maps are 
inequivalent problems, and the complexity of each must be resolved separately. 

Fortuitously, it turns out that a proof of NP-hardness for the embedding prob- 
lem is already "buried" within the NP-hardness proof for the Markovianity prob- 
lem. We now give a sketch of the reduction from the NP-complete 1-IN-3SAT 
problem to the Embeddability problem of Problem l30l. which closely follows 
the analogous reduction to Markovian map. For a full account, see Ref. [13]. 

Recall the conditions for Q to be a generator of a continuous-time Markov 
chain (a Q-matrixY (i) Qi^j > 0, (ii) Qj j = 0. Comparing these with the con- 
ditions in Lemmajsl and Eqs. (l34ar) and l34br) satisfied by Q and B'^ from Eqs. |3 lb 
and 1321) . we see that = Q + 2'KmcB^ alway s satisfy the normalisation condi- 
tion (i,i) for any integers m^. But, from Eq. (l34al) and the discussion thereafter, 
will satisfy condition (i) for some rric iff the original 1-IN-3SAT used to construct 
Q and B" was satisfiable. In other words, there exist integers rric such that Qm is 
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a Q-matrix iff the 1-IN-3SAT problem was satisfiable. But Qm parametrise log- 
arithms of the same matrix P = e*^'" . In fact, the only branches of the logarithm 
that are missing are branches that could never generate a continuous-time Markov 
chain in any case. So, either P is not stochastic (which can easily be checked), 
in which case the 1-IN-3SAT problem cannot be satisfiable, or P is stochastic, in 
which case it is embeddable iff the 1-IN-3S AT problem was satisfiable. 

To make this reduction rigorous. Lemma [lO| and Corollary [l4j must be ap- 
plied in very much the same way as in the reduction from LiNDBLAD GENER- 
ATOR to Markovian map in Theorem U3, to show that a weak-membership 
formulation of the Q-matrix problem can be reduced to the weak-membership for- 
mulation of the Embeddability problem (Problem l30l). (See Ref. [13_1 for a 
detailed treatment.) Similar arguments to those given at the end of Section |4| show 
that the generalisation of the embedding problem to the problem of determining 
whether a family of stochastic matrices are all generated by the same continuous- 
time Markov process is also NP-hard, for any number of matrices. Finally, it is 
clear how to adapt the algorithm of Sectionls] to the classical embedding problem, 
thereby proving equivalence to P=NP. 



7 Conclusions 

We have shown that the Markovianity problem for CPT maps and the analogous 
embedding problem for stochastic matrices are both NP-hard and, indeed, have 
shown full equivalence between solutions to these problems and a solution to the 
famous P=NP problem. Therefore, either P=NP, or there exists no efficiently 
decidable criterion for deciding whether a CPT map is generated by some under- 
lying Markovian master equation, that is, whether it is a member of a completely 
positive semi-group. Similarly for deciding whether a stochastic matrix can be 
embedded in a continuous-time homogeneous Markov process. 

An interesting corollary of the NP-hardness proofs for the Markovian chan- 
nel and Embeddability weak-membership problems is that: 

Corollary 31 Both the set of Markovian and the set of non-Markovian CPT maps 
have non-zero measure, as do the sets of embeddable and non-embeddable stochas- 
tic matrices, in any finite dimension. 

So a randomly chosen CPT map has a finite probability of being non-Markovian, 
but also of being Markovian. The analogous property holds for a randomly chosen 
stochastic map. Ref. Jvl] estimates these probabilities numerically for the simplest 
quantum case of qubits, i.e. CPT maps on C^. This fact alone may not be so 
surprising: After all, generators being ccp can have neighbourhoods of genera- 
tors that are ccp, which under exponentiation are mapped to neighbourhoods of 
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channels, giving rise to a finite volume. The above corollary makes this argument 
rigorous. 

One consequence of these results to physics is that to decide whether a given 
physical process at a shapshot in time — or for many snapshots for that matter — 
is consistent with being forgetful cannot be decided efficiently. This is because 
there is no a priori way of knowing whether the dynamics of an open system are 
Markovian or not, but finding the dynamical equations (master equations) would 
answer this question, and we now know this to be NP-hard for both the classical 
and quantum cases, requiring infeasibly long computation time (unless P=NP, of 
course). Whether this poses more practical difficulties is less clear. The results of 
Section [s] show that it at least does not pose a problem for the current generation 
of quantum experiments, since other purely practical limitations on the dimension 
of the systems being studied are more significant. More generally, one might 
argue that the average-case complexity is more relevant in practice, whereas NP- 
hardness only tells us about the worst-case complexity. What is the average-case 
complexity of the Markovianity and embedding problems? We close with this 
intriguing open problem, which we commend to the reader. 
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